Mixing Least - Squares Estimators
نویسنده
چکیده
We propose a procedure to handle the problem of Gaussian regression when the variance is unknown. We mix least-squares estimators from various models according to a procedure inspired by that of Leung and Barron [17]. We show that in some cases the resulting estimator is a simple shrinkage estimator. We then apply this procedure in various statistical settings such as linear regression or adaptive estimation in Besov spaces. Our results provide non-asymptotic risk bounds for the Euclidean risk of the estimator.
منابع مشابه
Mixing least-squares estimators when the variance is unknown
We propose a procedure to handle the problem of Gaussian regression when the variance is unknown. We mix least-squares estimators from various models according to a procedure inspired by that of Leung and Barron [IEEE Trans. Inform. Theory 52 (2006) 3396–3410]. We show that in some cases, the resulting estimator is a simple shrinkage estimator. We then apply this procedure to perform adaptive e...
متن کاملMemory-Universal Prediction of Stationary Random Processes
We consider the problem of one-step-ahead prediction of a real-valued, stationary, strongly mixing random process fXig1i= 1. The best mean-square predictor of X0 is its conditional mean given the entire infinite past fXig 1 i= 1. Given a sequence of observations X1 X2 XN , we propose estimators for the conditional mean based on sequences of parametric models of increasing memory and of increasi...
متن کاملLimiting distributions for explosive PAR(1) time series with strongly mixing innovation
This work deals with the limiting distribution of the least squares estimators of the coefficients ar of an explosive periodic autoregressive of order 1 (PAR(1)) time series Xr = arXr−1+ur when the innovation {uk} is strongly mixing. More precisely {ar} is a periodic sequence of real numbers with period P > 0 and such that ∏P r=1 |ar| > 1. The time series {ur} is periodically distributed with t...
متن کاملThe equalities of ordinary least-squares estimators and best linear unbiased estimators for the restricted linear model
We investigate in this paper a variety of equalities for the ordinary least-squares estimators and the best linear unbiased estimators under the general linear (Gauss-Markov) model {y, Xβ, σΣ} and the restrained model {y, Xβ |Aβ = b, σΣ}.
متن کاملThe equality of OLS and GLS estimators in the linear regression model when the disturbances are spatially correlated
Necessary and su cient conditions for the equality of ordinary least squares and generalized least squares estimators in the linear regression model with rst order spatial error processes are given
متن کامل